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DEVICE AND METHOD FOR RENDERING DATA 

Technical Field of the Invention 

The present invention relates to a device and method 
for rendering a sequence of data, and more specifically a 
method for rendering a first and a second sequence of data 
alternately in dependence of activation of an input 
interface of an electronic device. 

Description of Related Art 

Portable electronic devices more frequently comprises 
games, images, and audio data, which may be prestored by 
the manufacturer of the device or which may be downloaded 
to the device from a remote source. Games may be played on 
a variety of electronic devices, such as a computer, a 
mobile radio terminal, a communicator, an electronic 
organizer, or a smartphone. An image may be set as a 
background image of a display of the device. Images may be 
pleasant to look at for a while but they tend to be a bit 
boring due to their static nature. 

Contrary to the pictures are games more entertaining. 
However, the games have more or less complicated rules for 
determining how they should be executed to achieve a 
certain result. Depending on the skill of the user, e.g. 
which keys are actuated in a predetermined time period, the 
end result may differ significantly. E.g. a certain key may 
have to be actuated for to achieve a certain result, which 
the user has to have knowledge of before starting the game 
to be successful. Thus, even the simplest game requires 
some sort of learning. Also, the end result is almost 
always different, wherein the program instructions that are 
executed require a high processing capability. Thus, 
playing a game requires a considerable amount of battery 
capacity. At the same time, a portable electronic device 
has limited battery resources. 
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Moredver, when games are provided in portable 
electronic idevices they are often accessed through a menu 
structure. It is not instant and may be too complicated for 
many users to access and learn. Thus, some users use the 
5 electronic device to interact with to pass time, while 

others do not see it as a tool for passing time as looking 
at the background image is not stimulating and playing a 
game is too complicated. 

10 Summary of the Invention 

It is an object of the invention to provide a method 
for interacting with an electronic device to execute 
digital data being non-static when displayed, which digital 
data requires less processing capability than an electronic 
15 game. 

This object is achieved by a method according to the 
invention for executing a first and a second sequence of 
digital data in an electronic device having an input 
interface comprising at least one input means. According to 

2 0 the invention, a main sequence of digital data is initiated 

and executed, activation of at least one input means is 
sensed, execution of said main sequence is interrupted in 
response to said sensing, and at least one sub sequence of 
digital data being associated with said main sequence is 
25 initiated and executed when execution of the main sequence 
has been interrupted. 

A resume flag may be set at a position of the main 
sequence where its execution is interrupted, and when the 
execution of the sub sequence is ended, execution of the 

3 0 main sequence may be resumed at said position. Furthermore, 

execution of the main sequence and/or the sub sequence may 
be iterated a predetermined number of times or during a 
predetermined time period. 

The input interface may comprise several input means. 
35 Thus, according to the method a specific input means, or a 
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combination of specific input means, being activated is 
identified, and a certain sub sequence to be initiated, 
which is associated with said identified specific input 
means or combination of specific input means, is retrieved 
5 from a memory to be rendered. 

The main sequence and the sub sequence may comprise 
digital image or audio data. 

According to the method, digital data comprising a 
main sequence identity, at least one position wherein the 

10 execution of the main sequence is to be interrupted and at 
least one identity of a sub sequence to be executed at said 
interruption may be saved. Alternatively, digital data of 
the main sequence and at least one sub sequence as they are 
rendered are saved. Thus, a specific rendering of a main 

15 sequence and at least one sub sequence may be recorded and 
rendered. Furthermore, said saved digital data may be 
transmitted to an external electronic device. 

It is another object of the invention to provide an 
electronic device with which a user may interact to execute 

20 digital data being non- static when displayed, which data 
requires less processing capability than an electronic 
game. 

This object is achieved by an electronic device 
according to the invention comprising an input interface 

25 having at least one input means, and an output interface. 
An initiation unit for initiating execution of a main 
sequence of digital data, a sensing unit adapted to sense 
the activation of at least one input means, and an 
interrupt unit adapted to interrupt execution of said main 

3 0 sequence is provided. The initiation unit is further 

adapted to initiate execution of at least one sub sequence 
of digital data being associated with the main sequence 
when the interrupt unit has interrupted the execution of 
the main sequence. 
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A counter, which is arranged to count the number of 
executed iterations of the main sequence and/or the sub 
sequence, or which is arranged determine a time period 
during which the main sequence has been executed may be 
5 provided. Thus, the interrupt unit may be arranged to 
interrupt execution of the main sequence when a 
predetermined number of iterations or a predetermined time 
period has been reached. 

The electronic device may comprise several input 

10 means and a memory. The sensing unit may be adapted to 

identify a specific input means being activated, and the 
processor may be adapted to retrieve from said memory a 
certain sub sequence to be initiated, which is associated 
with said fiBpecif ic input means. 

15 A memory for saving at least parts of said main 

sequence and/or parts of said sub sequence, or information 
thereof, as they are rendered may be provided. Furthermore, 
a communication unit for transmitting said saved parts of 
the main sequence and/or the sub sequence may be provided. 

20 The electronic device may be provided as a mobile 

radio terminal, a pager, a communicator, an electronic 
organizer, a smartphone, or a mobile telephone. 

A third object of the invention is to provide a 
computer program product having computer readable 

25 instructions for carrying out the method of the invention. 

This object is achieved by a computer program product 
embodied on a computer readable medium, comprising computer 
readable instructions for carrying out the method according 
to the invention when run by an electronic device having 

30 digital computer capabilities. 

It is an advantage of the invention that a user may 
use the electronic device having a function that is 
interactive, explorative, instant and easy to access and 
extremely easy to use. Furthermore, it is an advantage of 
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the invention that it requires less processing capability 
and battery capacity than playing a game. 

Further embodiments of the invention are defined in 
the dependent claims, 
5 It should be emphasized that the term 

"comprises/comprising" when used in this specification is 
taken to specify the presence of stated features, integers, 
steps or components but does not preclude the presence or 
addition of one or more other features, integers, steps, 
10 components or groups thereof. 

Brief Description of the Drawings 

Further objects, features, and advantages of the 
invention will appear from the following description of 
15 several embodiments of the invention, wherein various 

aspects of the invention will be described in more detail 
with reference to the accompanying drawings, in which: 

Fig. 1 is a front view of a mobile terminal connected 
to external communication devices ; 
20 Fig. 2 is a block diagram of the mobile terminal; 

Fig. 3a is flow chart of a first embodiment of the 
method according to the invention; and 

Fig. 3b is a flow chart of a sub procedure of the 
method of Fig. 3a. 

25 

Detailed Description of Embodiments 

Fig. 1 illustrates an electronic device embodied as a 
mobile terminal 1. The invention is not limited to a mobile 
terminal 1, but can be incorporated into any electronic 

3 0 device having an output interface and an input interface, 

with which a user interacts. An electronic device according 
to the invention comprises, but is not limited to, a mobile 
radio terminal, a mobile telephone, a pager, a personal 
digital assistant (PDA), and a communicator, i.e. a 

35 smartphone or an electronic organizer. For convenience, 
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reference :to a mobile terminal 1 will be made throughout 

this description. 

The present invention provides a function wherein 

e.g. an interactive background animation may be rendered. 
5 The animation is provided by executing a sequence of 

digital data or instructions in a main sequence, wherein 

the animation may be displayed over again. When an input 

means of an input interface is activated, the execution of 

the main sequence is interrupted, and a sub sequence of 
10 digital data related to the main sequence is executed 

instead. When the sub sequence is ended, the main sequence 

may be resumed where it was interrupted. 

The mobile terminal 1 comprises an input interface, 

through which a user may interact with the mobile terminal 
15 1, and use to activate sub sequences as will be explained 

below. The input interface comprises one or several input 

means for activating one or several different sub 

sequences . 

The input means may comprise, but are not limited to, 

20 a keypad 10, a joystick 11, a slider 12, a microphone 13 

and a vibration sensor 14 (Fig. 2) , a touch screen 15 (Fig. 
2) or touch pad, a rocker key, and actuation keys, such as 
a camera, a volume, or an auxiliary key. The actuation keys 
may during conventional use of the mobile terminal 1 be 

25 used for accessing certain functions or executing commands, 
such as increasing/decreasing the volume, taking a picture, 
or entering different communication modes, such as data or 
voice communication modes. 

The keypad 10 comprises conventional keys for 

30 establishing and terminating a call, such as numerical keys 
"1, 2,..., 9", a "y es " and a "no" key. Further, the keypad 10 
may comprise additional keys, such as a u #" , a , a 
"clear" , a "return" , or any other key for entering or 
retrieving information into/from the mobile terminal 1. The 

35 numerical keys may also be used for accessing and/or 
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executing different functions of the terminal, such as 
playing a game or providing a key lock/unlock function. The 
numerical keys may also comprise letters for composing a 
text message. Each key may be associated with a certain sub 
5 sequence . 

The joystick 11 may be provided for navigating 
between different functions of the mobile terminal 1. 
Alternatively, the user navigates to a specific function 
with conventional push keys having an up/down function. The 

10 joystick 11 may also be used for navigating within menus. 
Selection within the menus may also be provided by 
actuation of the joystick if it has a push function. 

One or several sliders 12 may be provided at any side 
of the mobile terminal 1. The slider 12 may also be used as 

15 a shortcut to access and execute certain functions directly 
without the need of entering said function by navigating 
through menus of the display, such as a volume function. 
The slider 12 may alternatively be substituted by push 
buttons arranged at any side of the mobile terminal 1. 

2 0 Arranging said push buttons on another side than the keypad 

10 has the advantage that they can be easily distinguished 
from the keys of the conventional keypad 10. 

The microphone 13 may be used for registering the 
voice of the user during an ongoing call, recording a voice 
25 message, requesting a service through voice activation, 
such as the establishment or answering of an 
outgoing/incoming call. Also, the microphone 13 may be used 
for activating a sub sequence according to the invention. 

The vibration sensor 14 may sense vibrations caused 

3 0 by the user of the mobile terminal 1. The vibrations may 

originate when the user deliberately shakes the mobile 
terminal 1 so as to start execution of e.g. a sub sequence 
according to the invention. 

The mobile terminal 1 comprises an output interface 
35 100 for presenting information and data to a user. The 



WO 2005/041034 I 



8 



PCT/EP2004/010583 



input interface 100 comprises a display 20, which may be a 
conventional display for presenting information, such as 
presentation of a telephone number, remaining battery 
capacity, connectivity, function menus, icons, still/moving 
5 images etc. The display 20 may be a monochrome or a color 
display. Furthermore, the display may be a touch screen 
type display 21 (Fig 2) , on which the user may enter data 
into the mobile terminal 1 by writing directly on the 
screen with a suitable input device, such as a pen having a 

10 blunt plastic point. Thus, the display 2 0 may be part of 
both the output interface and the input interface. Also, 
the mobile • terminal 1 may comprise several displays 
provided at different portions of the terminal, which 
interact in operation. A clamshell or foldable mobile 

15 terminal may have one display on the outside of the 

housing, and one that will appear when said terminal is 
opened for operation. 

The input interface may comprise a loudspeaker 22 for 
listening to the voice of an incoming call, listening to 

20 music, presenting sound of a game, rendering a recorded 

voice, etc. An audio controller may automatically order or 
execute any change of the volume/bas/treble in dependence 
of sensed activation of an input means. The change may be 
provided during a certain period of time, corresponding to 

25 rendering a sub sequence. 

The mobile terminal 1 may also comprise a 
communication interface for communicating with an external 
electronic device 30a, 30b or a communication network. The 
communication interface may comprise a wireless and/or wire 

30 based interface. The wireless communication interface may 
comprise one or several antennas 15 and be arranged to 
communicate with the external device 30a via a wireless 
communication system, such as a telecommunication system 
according to any communication technique, e.g. a TDMA (Time 

35 Division Multiple Access) FDMA (Frequency Division Multiple 
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Access), or CDMA (Code Division Multiple Access) technique. 
Also, the communication interface may be adapted for 
communication over a short range supplementary frequency, 
such as a WLAN (Wireless Local Area Network) , e.g. a 
5 Bleutooth* frequency. The communication interface may also 
comprise means, e.g. an accessory connector, for connecting 
the mobile terminal 1 to the external device 30b by means 
of a wire, such as a series cable. 

Other wireless or wire based communication interfaces 

10 are also possible, such as an IR (Infrared) connection. 

The communication interface may comprise a receiver 
23 (Fig. 2) and a transmitter for transmitting voice, data, 
and other messages, such as messages comprising information 
regarding main and sub sequences. 

15 The receiver 23 of the communication interface may be 

part of the input interface. Then, activation of the 
receiver, which is triggered by an entity external to the 
mobile terminal 1 itself, e.g. a communication network, may 
be sensed. Activation triggered by an external device may 

20 comprise receiving a message, an incoming call, or any 
other data, such as data relating to a WAP (Wireless 
Application Protocol) data. 

The external electronic device 3 0a, 30b comprises an 
output interface, such as a display 31a, 31b, for 

25 displaying information to a user. The output interface may 
comprise the same output means as the mobile terminal 1 . 
Thus, instead of, or in addition to, rendering the data of 
the main and sub sequence by means of the output interface 
of the mobile terminal 1 itself, said data may be 

30 transmitted to the external device 30a, 30b. Thus, the data 
to be rendered may be processed by the mobile terminal 1 
but rendered by the external device 30a, 30b. As is 
understood, the external device 30a, 30b may also comprise 
an input interface corresponding to the input interface of 

35 the mobile terminal 1. 
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Fig.:' 1 2 illustrates the input interface of the mobile 
terminal lMof Fig. 1 connected to a sensing unit 140. The 
sensing unit 140 is connected to a controller 130, which 
may be provided as a CPU (central processing unit) , a 
5 microprocessor, or ASIC (Application Specific Integrated 
Circuit) . The controller 130 is connected to a memory 150, 
such as a RAM (Random Access Memory) and/or a ROM (Read 
Only Memory) for storing any information. Moreover, the 
controller : 130 is connected to the output interface 100, 

10 which is adapted to provide information to the user. 

The output interface 100 may comprise one or several 
controllers for controlling a certain setting or function 
of the mobile terminal 1 and the output interface. A 
graphical output interface may comprise a graphics 

15 processing unit (GPU) 101 having information regarding 

objects that shall be presented on the display 13, such as 
a background animation. The controllers of the output 
interface, such as the GPU 101, may be provided as a 
separate hardware component, e.g. as a processor, a DSP 

20 (Digital Signal Processor) , an ASIC (Application Specific 
Integrated Circuit) , a FPGA (Field- Programmable Gate 
Array), hard-wired logic, etc. Alternatively, the 
controllers are software- implemented means, which are 
provided by software readable code portions to be run by a 

25 processor. The graphical output interface may also comprise 
a buffer 102, wherein digital data, such as animation 
images or audio data, are stored before being rendered. The 
display buffer 102 may comprise separate buffers for the 
main sequence and the sub sequence. In the buffer for the 

30 main sequence, an interrupt flag may be set, as will be 
explained below. The buffer 102 is connected to the GPU 
101. The GPU 101 may be adapted for presenting still and/or 
moving images on the display 20. 

The controller 130 is connected to a communication 

35 unit 160 comprising a transmitter and possibly the receiver 
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23, which is provided for communicating with the 
communication network or directly with the external device 
30a, 30b. In Fig. 2 the receiver 23 is provided separately 
for illustrative purposes, as it may be part of the input 
5 interface. The communication unit 160 is connected to the 
antenna 15 for communication using a telecommunication 
frequency, such as GSM or WCDMA frequency, and/or a short- 
range complementary frequency, such as a WLAN frequency. 

A counter 170 is connected to the controller 130. The 

10 counter 170 is arranged to count the number of consecutive 
times a main sequence has been iterated, and notify the 
controller when a predetermined number of iterations has 
been reached. Alternatively, the counter may register the 
time, during which the main sequence has been executed, and 

15 notify the controller 13 0 when a predetermined time period 
has been reached. 

The sensing unit 140, to which the input means of the 
input interface are connected, is adapted to sense or 
register the activation of a certain input means. When the 

20 activation is sensed, execution of a main sequence of 

digital data or digital instructions may be interrupted. 
The digital data of the main sequence may comprise a 
background animation, i.e. a series of consecutive digital 
images which will provide a moving picture when displayed. 

25 Alternatively, the digital data of the main sequence may 

comprise audio data. When the execution of the data of the 
main sequence is interrupted, a sub sequence comprising 
digital data or instructions associated with the main 
sequence are executed or rendered. If a background 

3 0 animation is provided, the sub sequence may provide 

alternative digital images to complement the images of the 
main sequence. E.g. a skateboarder going back and forth in 
a skateboard ramp may be displayed by the images of the 
main sequence, wherein each sequence comprises images for 

35 displaying e.g. one lap in the ramp. The sub sequence may 
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then compose images displaying a trick made by the 
skateboarder. The trick is triggered by the activation of 
the input riieans. When the trick has been rendered, the main 
sequence may be resumed where it was interrupted. 
5 Alternatively, the execution of the main sequence is not 
resumed when the sub sequence has been rendered. Each sub 
sequence may be dependent on a specific input means being 
activated, or a combination of input means being activated 
substantially simultaneously, and/or the position of the 

10 sub sequence where it is interrupted. Also, the different 
sub sequences may be executed randomly independently of 
which input means is activated. Similarly, if the main 
sequence comprises audio data, the sub sequence may 
comprise different audio data, such as a solo by a specific 

15 instrument depending on the specific activated input means 
and/or where the execution of main sequence is interrupted. 

The sensing unit 140 may be provided by hardware or 
software according to the same principles as the GPU 101. 
Alternatively, the sensing unit 140 is provided as an 

20 integral part of the controller 130. 

When the activation of a certain input means has been 
sensed, the controller 130 may indicate the specific used 
input means to the output interface 100, which will 
retrieve and render a sub sequence from the memory 150 

25 accordingly. Alternatively, the controller 13 0 itself 

retrieves ; :from the memory 150 the sub sequence, which is 
forwarded to the output interface 100. 

Fig. j 3a illustrates one embodiment for carrying out 
the method according to the invention. In a first step 2 00 

30 the execution of main sequence is initiated. The initiation 
may be executed by selecting a specific icon or menu. 
Alternatively, the execution of the main sequence is 
initiated by pressing a specific key or key combination of 
e.g. the keypad 10. The initiation may also comprise 
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retrieving from the memory 150 the main sequence, which is 
forwarded to the buffer 102. 

Step 210 follows the initiation, wherein the main 
sequence is executed or rendered. E.g. images of an 
5 animation may be displayed in a consecutive order to 
provide a moving picture. 

To provide initiation of the sub sequence according 
to the invention, activation of any of the input means has 
to be checked by the sensing unit 140 regularly during the 
10 execution of the main sequence. Thus, in step 220 it is 
determined whether any of the input means is activated. 
This determination may be executed at predetermined time 
intervals during the execution of main sequence. 
Alternatively, the determination of step 220 is made after 
15 a full execution of the main sequence. 

If the answer in step 220 is no, the procedure 
proceeds to step 230, wherein the execution of the main 
sequence is continued. 

If the answer in step 220 is yes, the procedure 
20 proceeds to step 240, wherein the execution of the main 

sequence is interrupted. Also, an interrupt flag is set in 
the buffer 102 at the position of the main sequence wherein 
its execution is interrupted. The flag may be set at the 
position of the next data item of the buffer 102 to be 

2 5 displayed or the last data item being displayed. 

In step 250 the specific input means being activated 
is identified, such as a specific key, or combination of 
keys, of the keypad. 

In step 260, the sub sequence associated with the 

3 0 input means identified in step 250 may be retrieved. A 

lookup table within the memory 150 or a register of the 
controller 130 or the GPU 101 may provide which input 
means, or combination of input means, is associated with a 
specific sub sequence of the main sequence. Thus, the user 
35 may at any time default which input means should activate a 
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specific *iib sequence. When the specific sub sequence has 
been retrieved, it may be executed or rendered. Depending 
on the inp^it means being identified, the sub sequence may 
be rendered once or a predetermined number of times. 
5 In step 270, after the execution of the sub sequence 

is ended execution of the main sequence is resumed by 
starting the main sequence at the position of the interrupt 
flag. 

In step 280 it is determined if the execution period 

10 of the maiji sequence has come to an end. If main sequence 
is executed a predetermined number of times, the counter 
170 keeps track of the number of iterations. Alternatively, 
the main sequence is executed during a predetermined time 
period, which the counter 170 keeps track of. If the answer 

15 in step 280 is yes, the procedure is ended. Otherwise, the 
procedure will return to step 210, wherein the main 
sequence will be executed once again. 

It is also possible to record and store the execution 
of a main sequence and the execution of any number of sub 

20 sequences. Then, if a user of the mobile terminal 1 so 

decides, a recording function may be selected. Information 
identifying the main sequence and the position within the 
main sequence at which a specific sub function is to be 
executed is recorded. A recorded sequence may be 

25 transmitted to any external communication device 30a, 3 0b. 

Fig. 3b illustrates an alternative embodiment of the 
method according to the invention. The steps according to 
Fig. 3b may be executed after step 200 of Fig. 3a. In step 
201 it is determined whether a record function has been 

30 selected. If the answer in step 201 is no, the procedure 
proceeds to step 210, wherein the procedure will continue 
as described above. However, if the answer in step 201 is 
yes, a sub procedure will be entered. In step 202 the 
continuation of the main procedure of Fig. 3a is ordered. 

35 In step 203 the identity of the main sequence is 
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registered. The position of the main sequence wherein the 
interrupt flag is set in step 240 is registered together 
with the identity of the sub sequence being retrieved in 
step 260. Alternatively, the digital data of the main 
5 sequence and the sub sequence being rendered is recorded as 
it is read from the buffer 102 and rendered. 

Finally, the recording is ended in step 204 when the 
main procedure of Fig. 3a is ended. Thus, the main sequence 
and one or several sub sequences as rendered, or 

10 information thereof, will be recorded. 

In step 205 it is determined if a transmission of the 
recorded data has been ordered. If the answer is no, the 
sub procedure is ended. Otherwise, the recorded data is 
transmitted in step 206 before ended. 

15 The controller 130 may control the overall 

functionality of the electronic device, or control certain 
functions related to the invention. An initiation unit 131 
for initiating execution of the main and sub sequences, and 
an interrupt unit 132 for interrupting execution of the 

20 main and sub sequences is provided according to the 

invention. However, the initiation unit and the interrupt 
unit, as well as the sensing unit 140 and the counter 170, 
may be provided by the controller 130. 

The present invention has been described above with 

25 reference to specific embodiments. However, other 

embodiments than the above described are equally possible 
within the scope of the invention. Different method steps 
than those described above, performing the method by 
hardware or software, may be provided within the scope of 

30 the invention. The different features and steps of the 

invention may be combined in other combinations than those 
described. The invention is only limited by the appended 
patent claims. 



